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ABSTRACT 



Fiqht reading specialists and seven classroom 
teachers in Washinaton, P.C., tauaht the S T APTEF/101 reading prooram 
to 9R elementary school children in 1 ° 69 -to. The children were chosen 
because they ha* experienced considerable difficulty in learnira to 
read. The program, designed as a beginnino reading proaram for urban 
children, consists of workbooks promotino individual work with the 
occasional helD of a reader (teacher, tutor, etcl and can be used 
with individuals cr with aroups. Results of this study showed mean 
gains of 6.6 months on the Vide Range Achievement "est and similar 
gains on the °otel Word Opoosites Test, on the informal readinci 
inventory (Sheldon Series) , and on the Illinois Test of 
Psvcholinquistic Abilities, Auditory Association subtest. Reoorts of 
teachers and children were favorable, indicating the effectiveness 
and the appropriateness of STAPT p P/101 . Recommendations were made for 
extension and further study of the program. Tables are included. ( W S) 
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FOREWORD 



This report describes the results of a pilot program In which the 
author's STARTER/101 structured reading program for non-readers was used 
between November, 1969 and May, 1970, under the auspices of the Reading 
Center of the O.C. Public Schools. 

Eight reading specialists and seven teachers used the program with a 
total of 122 children in nine different elementary schools. Ninety-eight 
of these received pre and post test measures, and constitute the sample on 
which this report Is based. 

The children participating In the program were either non-readers or, In 
a few cases, several years behind In reading. On the pre-post readlna test 
administered to the children {Wide Range Achievement Test In Reading), 94* 
showed a measurable gain In reading. On the Botel Word Opposites test, a post- 
measure only, 66* of the children were at or beyond the l 2 grade level. On 
an Informal Reading Inventory (Sheldon), 56* of the children ere at or above 
the first grade level; all had moved out of the Readiness level. 

The children's performances on all reading tests used In this study were 
consistently confirmed by observation and classroom performance, and Indicated 
that most of the children did Indeed learn the rudiments of reading, and that 
they were able to use these skills In a variety of reading situations, Including 
test-taking, book reading, and reading in the classroom. 

This evaluation study was funded solely by the author, In order that major 
questions concerning the general usefulness and effectiveness of STARTER/101 
could be answered. Second order questions, which could not be enco;npassed In the 
present study should • be pursued when additional funds arc available. Further 
study will be necessary to answer the questions, "For what kinds of children, 
with what kinds of teachers, and under what conditions ,1s STARTER/101 most(and 
least) effective?", and "Were the children who learned to read then able to 
sustain and continue making progress In school?" 

The aim of the STARTER/101 program was to give children a firm grounding In 
the rudiments, and the Jo, , of readinq. The present evaluation Indicates that It 
clearly can do that. What will be built upon that foundation remains to be seen. 
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STARTER/101 is a newly developed, structured reading program written 
by Dr, Ann O'Keefe of the Educational Studies Department, the Washington School 
of Pjychiatiy, Washington, D.C. The program is intended for children between 
the ages of six and twelve who have encountered, or are expected to encounter, 
problems in learning to read. It i3 a sequential program that was designed toi 

• be fun for children to use 

• be relatively easy and satisfying for teachers to use * 

• include whatever readiness skills are necessary to help children 
learn to read 

• mato good use of children's existing strengths 

• present material to be learned in a systematically and gradually 
more challenging manner, such thati 

• , ^pacific skills to be learned are introduced one at a time 

• the new skill that is mastered is combined with previously 
learned skills, and 

• the new skill is iionediately practiced, in conjunction with 
familiar material, in a way that is challenging and interesting 
to the child. 
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Tho aim of STARTER/101 is to teach children to recognize, sound and print 
individual letters and combinationj of letters, and to read words, phrases, 
sentences, and simple stories. While the program’s first words are phonetically 
consistent (words such as U£ and top ), later in the program a large number 
of "sight" words such as two and beautiful are taught. 

During the summer of 1969 Dr. O'Keefe asked Mrs. Kay Lumley, Director of 
the Reading Center for the D.C. Public Schools, if the STA n TER/101 materials 
could be used by several reading specialists with children on a pilot basis, 
so that the program could undergo a preliminary evaluation. 

Mrs. Lumley agreed, and appointed Mrs. Eva Lofty, Assistant Director of 
the Reading Center, as coordinator of the program. Mrs. Lofty invited nine 
specialists to attend an orientation briefing given by Dr. O'Keefe, and to 
decide if they would like to use the program with a small number of non-reading 
children. All nine agreed, and early in November, 1969, they began teaching 
reading, using the STARTER/101 program. By February, 1970, 18 teachers were 
using the materials with lh6 children in grades 1 - 6, in 11 D.C. public schools. 

This is a report of the results of the use of the material with the 98 
children for whom both pre and post test results were obtained. These children 
were taught by specialists or by regular classroom teachers working in cooperation 
with specialists,* 



^Results of the program used by one teacher at Sharpe Health School, 
and by one teacher on his own at Cleveland, were not available at the time 
of this writing. These resultj will be reported in a later paper. 
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The Children 

The original sample contained 122 children. Table A indicates reason* 
why 2h of these children did not receive post-tests. 



Table A 

Reasons Why 2h Children Were Not Post-Tested 



Reasons for Lack of Post-Test Number of Children 



Moved out of school district 12 

Absent at time of post-testing 5 

Withdrawn by teacher as being too 

immature for instruction 5 

Transferred to a special education 
class 1 

No reason given 1 

Total 2h 

Of the 98 children for whom pre and post measures were obtained, the 
average chronological age at the time of pre-test (usually November, 1969) 
was 8 years-8 months, with ages ranging from $-10 to 12-10. The average I.Q. 
(Peabody Picture Vocabulary Test— Form A) was 65, with scores ranging between 
$8 and ll|l. There were kl glrlj and 51 boys. The majority wore in grades 1-3* 
but a few children were included from all elementary grade levels, as shown in 
Table B< 

Table B 

Distribution of Children by Orade in School 

Grade Number of Children 

1 10 

i 13 

29 
9 
1 
6 

Total 98 
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Twenty-eight of the children (about 2b%) had a documented history of severe 
non-educational problems, including physical, emotional, and social problems. 

An additional number of children also had problems that might be expected to 
interfere with school learning, but these problems were reported verbally, rather 
than formally. In general the children selected for inclusion in this 
pilot program were children who had several strikes against them, who had shown 
little or no school achievement, and for whom there wa3 a very guarded prognosis 
in terms of school progress in general, and reading achievement in particular. 

The Tests 

There were two pre-post measures, one pre-oniy measure, and two post-only 
measures, as listed in Table C. 



Table C 

Pre-Only, Post-Only, and Pre-and-Post Measures 



Pre Only 


Post Only 


Pre and Pojt 


Peabody Picture 
Vocabulary (PPVT) 
Form A 


Bo tel Word Opposites 
Test 

Informal Reading 
Inventory (IRI 
(Pre data also 
available for h9 
children 


Wide Range Achieve- 
ment Test (WRAT)-- 
Reading 

Illinois Test of 
Psychol inguj.s tic 
Abilities (ITPA)- 
Auditory Assoc. 



The main reading pre-post measure was the Wide Range Achievement Test 
(WRAT) in Reading, and the two post-only reading tests were the Botsl Word 
Opposites Test, and the Informal Reading Inventory (IRI) based on the Sheldon 
Series. Since h9of the 96 children had been tested on the IRI by the 

specialists before beginning STARTER/101, these scores are also included in 
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this report. Of the k9, 16 were at the Readiness Level, and only one at the 

1 2 3 

Primer (l ) Level, with the remainder at the PP*, PP , or PP Level? The 

Auditory Association subtest of the revised Illinois Test of Psycholinguistic 

Abilities was given pre and post, and the PPVT was given within the first 

feu weeks of the prograin, as an estimate of general echolastic aptitude. 

The WRAT was selected as a measure because it yields scores below the first 
grade level, and thus provides a finely graded, quantified index of pre-reading 
achievement (for example, letter discrimination and letter naming) even if the 
child is unable to read a single word. In fact, only one child in the sample 
was unable to obtain a score on the WRAT pre-test. This was an important 
consideration for the study, since if many children were unable to exceed the 
test "floor," no precise measure of reading gains made during the program would 
be possible. Moreover, while the WRAT emphasizes word recognition only, rather 
than comprehension, this was not viewed as a serious drawback for the STARTER/101 
study. It was anticipated that post scores would be well under the fourth-grade 
level, and for the most part within the first and second grades (a prediction 
which was correct). The need for a specific measure of reading conprehension was 
judged to be less critical at these reading level] than at later ones. Thus 
while a comprehension measure j as seen as desirable for the higher levels, the 
WRAT alone was judged to be a meaningful measure of reading skills at those levels 
actually attained by the majority of the children in the present study. The Botel 
Word Opposites wa.: added at the end of the year as a comprehension measure. For 
the Botel, the child reads a word and then selects an opposite from a choice of 
four (e.g., bigi bed, little , chair, boy). 

The XRI was inoluded as a post measure because i 1) it is routinely given by 
reading specialists and thuj yields a score that is familiar and readily interpreted} 

•PP 1 is Pre-primer, first level, and 1 j the lowest reading level. Pp3 precedes the 
first reader, or Primer, The IKI levels, then, are sequenced as follows i 
Readiness, PP*, PP 2 , PP*, Primer, l 2 , 2', 2 2 , 3\ 3 2 . 
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and 2) it estimates the child's instructional level, answering the question, 

"For what level in a basal series is the child ready?" 

The ITPA Auditory Association subtest is an oral test. It requires the. 

child verbally to complete an analogy such as: "Ico cream is cold} soup is 

This test requires no reading ability at all, and yields a Language Age score. 
Earlier research with a program similar to STARTER/101 had suggested that children 
who do not actually learn to read or master any of the measurable rudiments of 
reading by the end of a program often do make significant gains in srvoken language. 
The ITPA subtest was intended to identify such children. 

All testing was administered by the reading specialists, who have had 
training in tests and measurements, and who routinely tost children and evaluate 
their own teaching programs for the Reading Center, 

The Specialists and Teachers 

Eight specialists used the program from beginning (November, 1?6?) to 
end (May, 1970), (A ninth specialist was realigned, and turned her class of 
six sixth graders over to an experienced teacher in the building.) In addition 
to the specialists, a total of seven regular classroom teachers (including the 

teacher mentioned above) participated in the study. The specialists taught a 

2 2 
total of 6? children) the teachers taught 31 • 

Table D presents a summary description of the eight specialists and seven 
teachers by age, educational level, teaching experience, and previous participation 
in a special pilot projeot. 



2 This figure refers only to children who had both pre and pOit test®. In 
fact, more children than are represented by this figure were included in the 
pilot program, 



O 
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Table D 

Characteristics of Reading Specialists and Teachers 
Using STARTER/101 



Age 


Number c? 
Specialists 


Number of 
Teachers 


2 0-21* 




1 


25-29 




2 


30-3U 


1 


1 


35-39 


2 




Uo-l»U 


1 


2 


U5-U9 


2 


1 


50-5U 


1 




Over 55 


1 




Educational Level 


B.A. 


2 


7 


M.A. 


2 




M.A. plus 


l* 





Teaching Experience in Years 



2 




2 


h 




1 


5 




1 


9 


1 




11-15 


3 


2 


18-25 


h 


1 



Had Previous Experience Teaching 
In a Special Pilot Project 



Project READ 


3 




Basal Progressive Choice 


2 




Merrill Linguistics 

Special Junior Primary Project 


1 


1 



In general, the specialists using the STARTER/101 materials were somewhat older 
and more experienced than the teachers and had been involved in other pilot 
programs. All specialists reported their opinion that the program could be 
successfully used by regular classroom teachers, if a short training program 
were provided. All also offered the opinion that the STARTER program, despite 
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its simplicity, was by no means an "easy out," but requires much effort and 
planning on the part of the teacher, just as any program does.^ 

The Materials 

STARTER/101 is a set of ll* books. The earliest books are short and simple, 
to permit successful completion by the children. Each book follows the same 
general teaching pattern, designed to familiarize the children (as well as the 
teacher) with what to expect. In general. Books 1-11 introduce single letters 
and their sounds. At each step, previous learning is consolidated as now 
learning is presented. For example. Book 1 teaches U and P, with the resulting 
words u£ and pup . Book 3 teaches T and M, with resulting words (when combined 
with previously learned U and P of Book 1, and C and 0 of Book 2), such as 
top , mop , pot , cot . Mom and Tom . 

A few digraphs such as sh and th, and vowel variants such as the u in pull , 
as well as a few sight words such as a, I, and the are taught in the early books. 
However for the most part, these more complicated rudiments of reading skill 
are left for Books 12 - lU, where the concept of "long vowel, silent e." is 
taught, as well as a large number of consonant and vowel digraphs, and sight 
words. Usually digraphs were selected for inclusion in the program if they 
appeared among the 220 words of the Dolch list of most frequently used words. 

Sy the end of the program, it was intended that the children would have learned 
nearly all of the 220 Dolch words, as well as the rudimentary reading skills. 

These include: at least two vowel rounds for every vowel,* all major consonant 

sounds] and the most frequently used digraphs. See Attachment A for a more 
detailed description of the STARTER/101 program. 

^However, one of the regular classroom teachers, all of whose children only 
attained Book U by the end of the year, said she would not want bo uae STARTER again 
in a classroom situation. Another teacher, who taught 12- and 13-year-old sixth 
graders, said that while she liked the materials and thought they were helpful, she 
would want to select carefully children who would not find the program too "babyish" 
em. 
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Program Implementation 

All specialists and teachers used STARTER/101 on a small-group or individual 
basis. Teachers (including specialists) varied their approach to the program. Most 
began working with a small group, keeping the group together. After teacher and 
children had worked through the first few books, teachers began to encourage 
children to work on their own, at their own pace. Frequently one teacher would have 
several children working in different books. Teachers worked with the children in 
sessions of approximately 30 minutes, but here there was a wide range. On occasion, 
some sessions were as short as seven minutes, or as long as ?0 minutes. 

The specialists were fairly careful about keeping daily records of time spent 
using the program, but some teachers were unable to keep the counts. Table E sum- 
marizes the number of sessions and number of hours of instruction offered by each 
specialist and teacher, and the final books completed by his or her students. 
Obviously the number of books that was completed was largely dependent on the problems 
and initial reading retardation of the children, but it can be seen that in this 
study, the children who had the least time of instruction using STARTER/101, and who 
made the least progress through the books, were taught by teachers, not specialists. 



Table E 



Number of Sessions and Hours Offered by Personnel, 
And Number of Books Completed 




Specialists 


# Sessions a 


# Hours® 


Books Completed 


CodA 


Offered 


Offered 


By Post Test 


02 


uu 


22 


5, 8 


06 . 

od* 


71 


37.6 


6, 9 


17 


io.5 


11 


07 


69 


25 


7, 9, 12 


08. 


59 


30.6 


12, 1U 


08 U 


32 


17 


13 


10 


95 


5h.6 


111 


11 


96 


ii5 


8, 9 


16 


70 


18 


6, 11, lh 
lh 


18* 


101 


50 


la 


58 


28 


lh 



^Tnis specialist had a second group. The group began mid-year, in Book 6. 

•^This specialist also had a second group. The group began mid-year, in Book 9, 

a Due to children's absences, few children actually attended the maximum number 
of sessions and hours offered by each specialist/teacher. 
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Table E (cont'd) 



Teachers 


§ Session^ 


# Hour^ 


Books Completed 


Code 

6 


Offered 


Offered 


By Post Test 


01 


- 


- 




Ob,, 


91 


33.3 


9, 1' 


o o 


b8 


2k 


11* 


2k 


5.5 


9 


12 6 


31 


13.3 


7 


13 ; 

lb 8 


- 


- 


3 


21 


7.3 


5 



Result:;; 

Attachment 3 presents a summary listing of all test results from which the 

9 

results reported here were derived. 

WRAT (Reading) . The overall mean gain on the WRAT (Reading) for the 98 
children was .66 years (6.6 months). 10 For the 67 children taught by reading 
specialists, the mean gain was .8 years (8 months), and for the 31 children 
taught by regular classroom teachers, the mean gain was .1* years (1* month:;). 

Of the 98 children, three showed a negative score change from the pre to the po;t 
test period, and three children showed no score chanjge from the beginning to the 
end of the program. Table F Sicms a ftequaicy distribution and polygon of WRAT (Reading) 
score changes. 



Table F 

I. Frequency Distribution of WRAT (Reading) Score Changes (N = 98) 

WRAT Change in Months # of 
From Pre to Post Test Children 



-3 

-1 

0 

1 

2 

3 



1 

2 

3 

6 

8 

6 



_No records maintained, 

'Figures for thi3 teacher reflect time from mid-year (when children were in 
Book 6) to end. 

^Records not fully maintained; figures probably low estimates of time offered. 
'Results reported here are only partial, in the interest of providing immediate 
feedback on basic program results. Eventually more detailed analyses will be made. 
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The scores are based on a ten-month academic year. 
See footnote a on page 9* 



Number of Children Attaining Each Score Change 
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I. Frequency Distribution, WRAT-Reading (continued) 



Y/RAT Change in Monthi ft of 
From Pre to Post Test Children 

a 13 

5 8 

6 12 

7 10 

8 2 

9 7 

10 1 

11 1 

12 h 

13 1* 

Ik 2 

1 * 1 

16 1 

17 2 

18 2 

21 1 

29 1 



Total 90T 

II. Frequency Polygon of WRAT (Reading) Score Changes (N a 98) 




WRAT Score Change foon Pre to Post Test Period in 
School Years 



O 
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Table 0 shows the percentage of children (based on figures in Table F) 
whose Y/RAT score ohanges fell into selected ranges. 



Table G 



Percentage of Children With Various WRAT Score Changes 
I. Table of Percentages 

Change in Months % of Children 



to 0 
to 1+ 
to 6 
to 10 
11 to 18 
21 to 29 



1 

5 

7 



Total 99 




II . Histogram 
$ 0 r 





Y/RAT Score Change from Pre to Post Test Period 
In School Years 



11 



Percentages do not add to 100, due to rounding. 
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During the 7 calendar months of the project, then, 91$ of the children 
showed some measurable progress on the WHAT, and gained between $ and 29 

months (.5 &nd 2.9 school years) on that measure. 

Botel Word Opposites Test . Table H shows the distribution of scores obtained 

on the Botel Word Opposites test at the end of the school year. It is intorosting 
to note that many of the participating specialists felt that their children would 
be quite unable to perform at all on the Botel because of the difficulty of the 

test. However, only lU children were really untestable. The 18 children who 

2 

registered "Below 1 " were able to function on the test, but scored fewer than 

2 

seven of ten possible items correctly, (l , or Level A, is the lowest level of 
the Botel, and a score of 70^ or better suggests that the child is at about the 
second half of first grade in reading.) 



Table H 

Distribution of Botel Word Opposites Test Scores, Post Only 

Botel Word Opp. Score # of Children 

Untestable lU 

No Data (Children 



Absent) 



Below 1* 

H 



% 

£ 



18 

2h 

16 

4 

9 

6 

U 

TotaFW 



Many specialists gave the Botel to children in groups (all other tests were 
of necesjity given on an individual basis). It vxas interesting to note that many 
children continued taking the tost long after they were able to make correct 
responses. This, coupled with comments made by those who administered the test, 
was taken as some indication that the children did not find the test-taking situa- 
tion threatening or distasteful. Indeed, some even seemed to enjoy it. 
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The IRI . The Sheldon IRI (Infomal Reading Inventory) was acfoinisterod to 
all children except seven who were absent at the timeof testing* Table I shows 
the distribution of IRI scores obtained at the end of the schoolywar. 

Table I 

IRI Scores by Number and Percentage of Children, Post Only (N ■ 91) 



IRI Grade Placement 


Number of 


Percentage < 


Level, Post 


Children 


Children (N 


Readiness 


0 


0 


P re -primer 1 


17 


18 


Pre -primer 2 


15 


16 


rre-Drimer 3 


6 





Primer (First Reader) 


5 


12) 


ij 


16 


9 


2 1 


19 


21S 56* 


2 2 


8 


9\ 


3 1 


5 


y 


Total Tested 


91 


?7 12 



Absent: 7 

Fifty-six percent of the children tested on the IRI obtained scores which 
indicated they were ready for placement in a first grade reader (P, or l 1 ) or 
above. No children were at the Readiness level. 

As noted earlier, there were 1*9 children for whom IRI scores had also been 
obtained at the beginning of the program. Table J shows the distribution 
of IRI placement scores for these 1*9 children, on both a pre and a post basis. 



12 




Percentage does not equal 100, due to rounding 
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Table J 

IFJ Placement/ Scores by Number of Children, Pre and Post (N a it?) 



I. Frequency Distribution 

IRI Placement Level 



PfiSt 

Number of 
Children 



POST; 
Number of 
Children 



Readiness 


16 


Pre -primer 1 


6 


Pre-primer ? 


18 


Pro-primer 3 


8 


Primer (First Reader) 


1 


H 


0 


£ 


0 


& 


0 


3 1 


0 



0 

7 

5 

5 

0 

lit 

n 

6 

1 



Total k9 



h9 



II. Frequency Polygon 



E 

CD 

XI 

o 

rt 

W 

+> 

G 

CD 



i 



O 





IRI Placement Level 




PRE Scores: *• 
POST Scores : - 
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Tablo I shows that at the start, all but one of these U9 children were 
leading below the primer (first reader) level. On the post test, 32 children 

t 

were reading at or above the 1^ level. Further, all of the 16 children who 
were at the Readiness Level in the beginning, had advanced beycnd than levol by 
the time of the post-test. 

, The ITPA Subtest . The mean Auditory Association Subtext Language Age (LA) 
at the start for 93 children who had both a pre and a post ITPA subtest, was 6 years - 
3 months, as compared with a mean chronological age of 8 years-8 months. The mean 
LA at the end was 6 years-8 months. The mean gain in months of language age, from 
pre to post test period, was approximately 5 months. Twenty-one children showed 
losses when measured at the end of the year, 65 showed gains, and 7 showed no 
score change. 

Discussion 

All reading measures indicated that the vast majority of the children who 
used STARTER/101 were able to read to sane extent by the end of the school year 
(See Tables F -J , pp. 10-15). This consistent trend of positive change scores on 
the reading measures is especially notable since most of the children had a history 
of school non-achievement or school failure, and were behind in reading at the 
beginning of the year. They were non- readers at the "readiness" level, or very 
poor readers at the level of the earliest pre-primers. 1 ^ Yet, for the mo t part 
these children were not classifiable as mentally retarded, as indicated by the mean 
PPVT IQ score of 85. They did, however, show a host of physical, social and 
emotional problems, often related to school failure. These problems included 



• "it will be recalled that IRI evaluations were available on a pre-post basis for 
dnly U9 of the 98 children; however specialists (who were responsible, usually, for 
the selection of the children, maintained that, for the most part, they selected only 
children at (or below) the PP’, PP* or PP 1 level. However, or.e remedial class of 
sixth graders (N ■= 6) was retarded in reading but did have five initial reading scores 
at the second and third grade level 
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excessive absenteeism, general immaturity, severe home problem i, and physical 
problems which had even brought some children to various D.C. clinics and 
hospitals for physical and neurological evaluation. In short, the c)iildren using 
STARTER/101 generally were functional non-readers with a history of poor school 
progress, and a poor prognosis with respect to learning to read. 

It is unfortunate that there were no control or comparison groups for this 
project; more massive testing and data collection than that undertaken was 3imply 
beyond the resources of the present study. However, the data reported in full in 
Attachment B will permit the D.C. School system to make some comparative estimates 
between the results obtained with STARTER/101, and the results obtained with 
other approaches used with similar children. 

Research findings, such as those reported in the Bond and Dykstra study , ^ 
clearly indicate that no cue method or approach is best for all children, and 
that the appropriate question is, "What approaches are most effective with what 
kinds of children, taught by what kinds of teachers, under what conditions?" This 
report recognizes the vital importance of that question, but does not attempt to 
answer it, at this time, for STARTER/101. This year's program was intended to 
yield a preliminary estimate of the general value of the program, and to see if 
the program was able, under any conditions, to meet its goal. This goal may be 
defined as helping non-reading children learn and use the rudimentary reading 
skills necessary to read simple, first- and second-grade level written materials, 
and thereby be able to participate in and benefit from regular classroom 
instruction and experiences. There was ample evidence both from tests and 
observations, that STARTER/101 can assist teachers help many "high risk" 

l^Bond,0.L. and Dykstra, R. Coordinating Center for First-Grade Reading 
Instruction Programs, Office of Education, Project No. X-001, Contract No. 
0E-5-1C-26 IT, February, 1?67. 
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non-reading children accomplish this goal during a single school year— in fact, 
in less than 55 hours distributed over a 7 month period (November 1969-May 1970$ 
ofe Table £, p. 9). Not only did 56/6 of the children score at or above the 
primer (first reader) level on an Informal Reading Inventory given at the end of 
the program (Table I, p. lb)j in addition, teachers commented that by the completion 
of Books 9 or 10, many children were beginning to branch out into reading regular 
books, .mch as the I Can Read Books , the Dolch easy readers, and variou; Dr. Seuss 
books, and into other school programs such as the Sullivan READ oookj and whatever 
basal reading instruction ..eries was u-;ed in their clas.>room>. Numerous verbal 
reports were made by the classroom teachers to the specialists that the children 
were behaving better, participating more, and seeming to enjoy life in the 
classroom more than in their pre-STARTER days. Further study is required to 
document such by-products of success in learning to read; it is enough here to 
mention that such by-produots appear to have existed in many cases. 

Teaching personnel for the most part found the program simple to use on the 
one hand, but hard work on the other. Of the seven specialists and four teachers 
for whom program evaluation questionnaires had been received at the time of 
this writing, nine said they felt comfortable using the materials by the end of 
Book h} one teacher did not comment on that question (Question 15) and another 
states, ", . .1 never actually depended on the manual." 

One person commented verbally that if she had a choice, she would rather 
have access to STARTER/101 than have a teacher-aide, because STARTER/101 provided 
realistic planning, schedules and activities for the children. But there seemed 
no doubt that effective use of the program required additional work on the part of th 
teacher/.ipecialist . This work took the form of providing appropriate supplementary 
reading books, teaching frequent review lessons, devising games and activities to 
strengthen auditory discrimination, making word and letter games, making extra 
practice pages for the children, and making Word and picture cards with STARTER/101 
words and pictures. 
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There is considerable evidence that three of the regular classroom teachers 

would have benefited from additional orientation to the program and supportive 

guidance while using it. Certainly the fact that no children progressed beyond 

Book 3 and 5 for two teachers suggests that they were not making the most effective 

use of the material; why they ware not, is of course open to question. In any 

event, since four teachers (two with little, and two with considerable experience) 

were able to use the program routinely and consistently in their classroom, there 

in evidence that the program can be used in regular classrooms, as well as by 

jpecialiots in a small-group setting. It should be noted that one specialist 

trained a small core of superior readers in the upper elementary grades of her 

school, to act as tutors for children in Books 1-5; she found that these tutors 

could be quite helpful. One teacher also commented that older (reading) children 

had been able, at times, to help younger children. Since the author has t.'dned 

15 

high school seniors to use the program effectively, the question is not, "Can 
classroom teachors in general uje STARTER/101 effectively?" but rather, "What kind and 
how much training and support do what kinds of classroom teachers need, to effectively 
and efficiently u e STARTER/101 under various conditions?" 

The discussion would be remijs without some mention of the ITPA Subtest 
pre-post scores, which reflected a loss in language facility for 21 children. 

The ITPA Auditory Association Language Age scores were difficult to Interpret. An 
earlier study ^ using similar materials to teach reading to young diiadvantaged 
children had indicated that language age gains were quite large following even a 
small "do3e" of the program. Indeed, specialists and teachers alike commented 



^O’Keefe, Ruth Ann, Cort, H.R. Jr., Keohane, Ann, and Mattis, Margaret A. 

•■The Development of a Reading Curriculum for the Junior Village School" (A Report 
prepared for the Director, Dept, of Public Welfare, D.C» Government, under D.P.W. 

N.S. .Contract Ho. 68163) Washington School of ??ychiatry, August, 3969* p. 10 . 

*°lbid,, p. L6. "... the nean gain was 10 months. Thirteen of the 16 vhilticn'-. 

sco re's" (on th: Auditoiy Association subtest of the ITPA) reflected gtin ; illh seven 
improving lb months or more during the course of the 2-5$ months tutoring program," 
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repeatedly on the usefulness of STARTER/101 as a tool for language development. 

Thus, the finding that 21 children had language age score losses came as a 
surprise, in the face of the informal evidence that the children became much more 
verbal and adept at school-type verbal language, and in the face of tte formal, 
documented evidence of consistent reading gains. Moreover, a logical analysis of 
the STARTEVlOl methods and materials suggests that the program would increase 
verbal facility, since it has a strong verbal language component built in. An 
explanation for the language age losses may be sought in a possible decrease in test 
taking motivation for some of these 21 children at tho time of the second 

testing. VJhatever the explanation, this author finds it difficult to believe that 
any child actually knew less lnaguage at the end of this program--or at the end of 
any other program for that matter, and she is inclined to leavo these language 
losses as uninterpreted, and perhaps unlnterpretable. 

Summary and Conclusions 

Eight reading specialists and seven regular classroan teachers taught the 
STARTER/101 reading program to 67 and 31 children, respectively, during the 1969-70 
school year. The 96 children were in Orades 1-6, with most coning from Orades. 1-3. 
All children selected for inclusion in the program were children who were exper- 
lencing severe problems in learning to read. Nearly all were functional non-readorc 
Their mean CA at time of pre-testing was 8 years-8 months, and their mean PPVT 
was 85. 

The overall mean gain in reading achievement as measured by the Vide Range 
Achievement Test in Roading was 6.6 months j for the specialists alone it was 8 
months, and for the teachers alone it was b months. 

On the Potel '..'ord Opposites Test, used only as a post- test measure, all except 
lb children scored in or above tho first-grade le.el. Sixty-six percent scoied at 
the level or above. 







Cn the IRL (Sheldon series), $ 6 % of the children scored at or above the 
Primer (First Reader) level. None scored at the Readiness level. In a sample of 
h9 children for whom IRI pre -tests were available, the pre-te.sts showed that ' 
all except one (98$) were below the Primer level (one was at the Primer level). 

The pojt-tejts for these 1*9 children showed that 32 (6;#) were at or above the 
l 4- level, with only 17 (35/0 at variou.i pre-primer levels. Thu:, for those 
L 9 children, 9C£ were reading below the Primer level on the pre-test, but only 
3#? were gt pre-primer levels on the post-test. 

On the ITPA, Auditoiy Association Subtest, children made gains, but ?1 
children showed some decrease in measured language facility. The mean gain in 
language age as measured by this subtejt was five months. 

Depending on their schedules, specialists offered a total of between 22 and 
55 hour* of instruction tulng STAP.TEP/lOl. Some teachers did not keep records 
consistently, but there is evidence that s>, r.e used the material for as much as a 
total of 33 hours, and others, less than ten hours. 

There ware notable and consistent reports by teachers that the children, for 
the moit part, enjoyed the program, and that the teachers felt comfortable using 
it. All specialijts said they would like to continue or expand their STARTER/101 
program next year; two teachers had reservations about continuing to uje the program 
under present circunstancea. Observations by the program's author indicated that, 
for the most part, the program was being used quite satisfactorily. Additional 
research ia necessary now to determine more precisely for what kinds of children 
(and teachers) and under what conditions, STARTER/101 is most appropriate end 
effective in helping children learn to read. 
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Addond u n/Recommendatlon 

Arrangements have recently been made with Silver Burdett Corpany to publi ;h 

5TARTFJR/101. Plans call for an experimental version of the program (a 10-bock 

revision of the program described in this report and used by the Reading Center) 

to be used in a sample of school systems throughout the country during tho 1970-71 

school year, with a commercial edition to be available for the 1971-72 school year. 

Silver Burdett has expressed its interest in having the D.C, Schools participate 

next year, and has indicated its willingness to furnish a limited number of copies 

17 

for further evaluation purposes. 

The author recommends that the D.C. Public School system continue and expand 
its uje of STARTER/101 next year, both through the Reading Center, and through 
its Department of Instruction, for expanded use in regular first, second and third 
grades— especially in second and third grades where children have demonstrated a 
problem in learning to read. The program has already gotten off to a good start, 
and fifteen specialists and teachers in the D.C. system have developed a capability 
for using the materials. Thirteen of these people have specifically Indicated 
their desire to use STARTER/101 next year, and expressions of interest from other 
specialists and teachers have been received by the author and this year's participant: 

Further evaluation, both by the D.C. School system and by the publishers, 
could perhaps shed mol's llgit on some of the questions raised in this report, and 
provide valuable information with respect to this approach to teaching reading to 
non-readers. 
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'For anyone not in the evaluation study, the conpany will make the program 
available on a cost basl3 of about $10 per set, if orders are placed before July 
1 , 1970. Arrangements can be made by contacting! 

Product Manager for Language Arts 
Silver Burdett Company 

Morristown, New Jersey 07960 Phone t 201-536-ObOO 




Attachment A 



A Description of STARTER/101 t A Structured Beginning Reading Program 

for Children 



STARTER/101 was developed as a beginning reading program geared primarily to 
first, second and third grade urban children. The underlying assumptions of the 
program are (1) that there are already good and appropriate teaching materials 
available for urban children f whether the educator leans towards programmed mater- 
ials | structured materials f basal readers f or a language experience approach, and 
(2) that so-called "disadvantaged" children have the potential to master all basic 
skills and concepts that are required for reasonable and adequate reading ability 
and enjoyment. The goal of the new program, STARTER/101, is to prepare these 
children - many of whom come to school with a rich background of skills, but skills 
which unfortunately are often unlike those needed for academic success - to learn 
to use, enjoy, and benefit from some of the excellent materials available - avail- 
able but out of reach until certain basic skills have been accepted and mastered. 

The program takes into account three large problem areas. First, STARTEP/101 
is designed for easy use by teachers. Our experience has been that, too often, 
beautifully designed and conceptually excellent materials are simply not feasible 
for actual use by teachers f they make too many demands upon them. Many parts of 
the program have been tried by teachers, and in fact high school seniors were able 
to use the system effectively as tutors with young disadvantaged children, after a 
brief training period. 

Second, the program is designed to be interesting to the young children for 
whom it is intended. It is largely baaed on sounds and words familiar to the child. 
Further, the program assures familiarity by developing the children's spoken lan- 
guage prior to the introduction of printed language (reading). The content of this 
particular program is specifically geared to young children, both in word usage and 
in illustrations. Many appealing cartoons, as well aa pictures of Negro and white 
children and adults are used to help teach the skills and concepts covered in the 
program. Thus, within the framework of the program, an underlying concern is to 
make the materials and activities fun and interesting, from the point of view of the 
youngsters using it. 

Third, the program takes into account the fact that many children do not remain 
in one school for an entire school year. Many beginning reading programs are de- 
veloped as continuous two or three-year programs,- but the fact is that, in our mo- 
bile society, many children are unable to stay in one school that long. STARfER/101 
should help equip youngsters to adapt to subsequent reading programs, even if they 
must leave the program before completing it. To this end we have edre fully examined 
several different types of reading programs (including pro grace ed and basal) and 
have specifically included the teaching of a number of skills which will help the 
child move more smoothly into other programs. 

Program Goals 

Upon completion of the total program (approximately 4-8 school months of daily 
50-45 minute sessions, depending on a number of factors) the child will be able toi 



• recognize, sound and print all letters, both upper and lower case 

. recognize, sound and print combinations of letters 

. recognize, sound and print the most commonly used English letter-compounds* 

• read and, to some extent, spell words containing the linguistic elements 
included in the program 

• read simple phrases, sentences and stories using the linguistic and 
phonetic elements taught 

• read sight words drawn from the Dolch basic word list and other selected 
word lists (these will be words such as "you" and "beautiful" — words 
whose spelling is not easily derivable from the taught linguistic skills, 
but words that are frequently used in materials written for young children) 

Upon completion of approximately the first half of the program, the child will 
be able tot 

. recognize, print and give at least one sound** for each letter (upper and 
lower case) 

• recognize, sound and print the digraphs "sh" , "all", "ee", "th", and "qu" 

• read words, phrases, sentences and stories composed of all elements taught 

. read more than 150 of the 220 Dolch words, in meaningful contexts 

Program Process 

The program ia essentially the product of a task analysis of the problem of 
learning to read* The program delineates and sequences literally hundreds of ob- 
jectives which if accomplished, should help a child develop the ability to read 
simple written material* In the process by which these objectives are achieved, 
learning proceeds step-by-step* The child learns very little new material at a time, 
and he then combines or consolidates the new learning with previously learned or re- 
view activities. Although the process of learning is in many ways similar to that 
of other structured programs, the underlying philosophy, content and sequence of the 
objectives of this progrsm are quite different from those of other programs* 



* The most commonly used letter compounds are determined according to whether or . 
not they appear in the most frequently used words on standard word lists, such 
as the Dolch basio word list. Thus, for example, "ow" and "ea" are taught be- 
cause of Doleh words such as "down" and "eat", but "oi" is not specifically 
taught because there is no "most frequent" word that uses the "oi" compound. 
Operationally, then, standard word lists were used to delimit the content of 
the new program* 

** Short YOweJ sounds are used. Additionally, there are five letters for which 
more than one sound is learned during the first half of the program! e, u, y, 
c, and g. 

e as in me u as in up y as in happy e as in cat g as in jgot 

e as in ever u as in put y as in my e as in city g as in £em 

”* y as in yes 
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Tho first of four major steps in STARTER/101 's teaching-learning process i3 the 
Language Development phase, which makes sure that the child can speak, understand 
and use the specific words he will be reading. (This step is given heaviest emphasis 
during the earlier part of our program, but is included to some extent throughout 
the program. ) 

The second step is the Perceptual-Motor phase, where the child learns to re- 
cognize, sound (not name) and print one new letter in both its upper and lower case 
form. (The first four letters in the program - U, P, C and 0 - were selected pri- 
marily because their upper and lower case forms are nearly identical except for size. 
Pilot testing indicated that the U, C, and 0 shapes can be taught so that, despite 
their similarity in visual shape, they are readily learned.) The major considerations 
in sequencing letters - considerations which were given different weights at dif- 
ferent times - were the letters' inter-letter visual and auditory dissimilarity, their 
intra-letter upper and lower case similarity (the first four letters, ar mentioned 
above, were deliberately chosen to eliminate the upper-lower case problem for the 
children in the beginning), and the number of relevant and useful words they make. 

The third step, Combining, it one in which the child learns to combine the new 
letter with previously learned letters. In most cases these "combinations" are 
meaningless and thereby provide no meaning or contextual clues; the child must figure 
out these tasks solely on the basis of his sound-symbol association skill. A major 
consideration in selecting combinations was that they occur in the words/ Thus, 

"word parts" (or letter combinations) which occur frequently in words were emphasized - 
"word parts" , such as uw, 1st, 0£, eat , etc. 

The final major step is Reading Development, where the child incorporates the 
letters and letter-combinations into words — words the meaning of which he learned 
(or at least had called to his attention) during the first step, Language Develop- 
ment. In Reading Development he progresses from words to phrases to sentences and, 
during the latter part of the program, to simple stories. 

After the child has mastered a particular seotion of the program (usually 
teaching one letter, or digraph, or sight word), he moves to the next, where the 
process begins all over again, with the child oycling back to spoken language and 
moving from spoken to written language in an orderly and carefully sequenced manner, 
with materials especially designed to appeal to him. 

Program Materials 

The original program consisted of 14 workbooks (1021 pages) and a teacher's 
manual for Books 1-6. The revised program 2 will have 10 workbooks (864 pages) and 
a complete manual. The large number of workbooks is needed because the pages are 
designed to be attraotive and uncluttered . 

The workbooks are designed for a great deal of Independent work, but the nature 
of the program requires the assistance of a reader (teacher, aide, tutor, etc.) 
periodically throughout the program. The main educational function of this teacher 
is to provide the sounds associated with the symbols, but in fact, we believe a 
warm, responsive, constructive adult leader is vital in the educational lives of 
young children. Many children become discouraged while trying to learn to read, and 
the teacher can provide a vital service to the child by setting up reasonable guide- 
lines, rules, and educational goals, and supplying the encouragement many children 
do not receive. 

^For supportive rationale, see Oibson, Eleanor J., "Learning to Read," Science , 

148! 1066 - 1072 (Hay 21, 1965) 

e published by Silver Burdett Publishing Company, Morristown, R.J. 07960. 
rimental edition! September 1970| Cotaercial edition! September 1971 




The program can be used on an Individual, email group, or independent basis* 

A Combination approach, with some individual work, some small group work, some 
total olass work, and some independent work, has been used by most teachers and is 
probably effective in most situations, permitting most rapid progress by most 
children. 
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TEST RESULTS FOR UGHVIIXIAL CHILDREN TADOHT BT SPECIALISTS AND TEACHERS 
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